Clean Vibes: Hand Washing Monitoring Using Structural Vibration Sensing

We present a passive and non-intrusive sensing system for monitoring hand washing activity using structural vibration sensing. Proper hand washing is one of the most effective ways to limit the spread and transmission of disease, and has been especially critical during the COVID-19 pandemic. Prior approaches include direct observation and sensing-based approaches, but are limited in non-clinical settings due to operational restrictions and privacy concerns in sensitive areas such as restrooms. Our work introduces a new sensing modality for hand washing monitoring, which measures hand washing activity-induced vibration responses of sink structures, and uses those responses to monitor the presence and duration of hand washing. Primary research challenges are that vibration responses are similar for different activities, occur on different surfaces/structures, and tend to overlap/coincide. We overcome these challenges by extracting information about signal periodicity for similar activities through cepstrum-based features, leveraging hierarchical learning to differentiate activities on different surfaces, and denoting "primary/secondary"activities based on their relative frequency and importance. We evaluate our approach using real-world hand washing data across four different sink structures/locations, and achieve an average F1-score for hand washing activities of 0.95, which represents an 8.8X and 10.2X reduction in error over two different baseline approaches.Copyright © 2022 Association for Computing Machinery.

Social Distancing Compliance Monitoring for COVID-19 Recovery through Footstep-Induced Floor Vibrations

Monitoring the compliance of social distancing is critical for schools and offices to recover in-person operations in indoor spaces from the COVID-19 pandemic. Existing systems focus on vision- and wearable-based sensing approaches, which require direct line-of-sight or device-carrying and may also raise privacy concerns. To overcome these limitations, we introduce a new monitoring system for social distancing compliance based on footstep-induced floor vibration sensing. This system is device-free, non-intrusive, and perceived as more privacy-friendly. Our system leverages the insight that footsteps closer to the sensors generate vibration signals with larger amplitudes. The system first estimates the location of each person relative to the sensors based on signal energy and then infers the distance between two people. We evaluated the system through a real-world experiment with 8 people, and the system achieves an average accuracy of 97.8% for walking scenario classification and 80.4% in social distancing violation detection. © 2021 Owner/Author.